Adaptive and Decentralized Operator Placement for In-Network Query Processing
نویسندگان
چکیده
In-network query processing is critical for reducing network traffic when accessing and manipulating sensor data. It requires placing a tree of query operators such as filters and aggregations but also correlations onto sensor nodes in order to minimize the amount of data transmitted in the network. In this paper, we show that this problem is a variant of the task assignment problem for which polynomial algorithms have been developed. These algorithms are however centralized and cannot be used in a sensor network. We describe an adaptive and decentralized algorithm that progressively refines the placement of operators by walking through neighbor nodes. Simulation results illustrate the potential benefits of our approach. They also show that our placement strategy can achieve near optimal placement onto various graph topologies despite the risks of local minima.
منابع مشابه
A Reflective NetGAP Design and its Session Mechanism Realization based on Agent Songsen Yu and Yun Peng Optimizing of SVM with Hybrid PSO and Genetic Algorithm in Power Load Forecasting
For a query committed on a node on ad-hoc networks, the data and the relational operations related to the query are distributed widely around the autonomous nodes in the underlying network. Under that condition, innetwork query processing is most efficient query evaluation strategy which actually places a tree of relational operators such as filters (joins) and aggregations onto nodes so as to ...
متن کاملEfficient Index-based Processing of Join Queries in DHTs
Massively distributed applications require the integration of heterogeneous data from multiple sources. Peer-to-peer (P2P) is one possible network model for these distributed applications and among P2P architectures, distributed hash table (DHT) is well known for its routing performance guarantees. Under a general distributed relational data model, join query operator, an essential component to...
متن کاملA Convolutional Neural Network based on Adaptive Pooling for Classification of Noisy Images
Convolutional neural network is one of the effective methods for classifying images that performs learning using convolutional, pooling and fully-connected layers. All kinds of noise disrupt the operation of this network. Noise images reduce classification accuracy and increase convolutional neural network training time. Noise is an unwanted signal that destroys the original signal. Noise chang...
متن کاملOperator Placement Techniques for Distributed Stream-Processing Systems
The idea of pushing query operators to nodes within the network helps distributed streamprocessing systems to use their pool of resources more efficiently than ever. However, determining placement locations is challenging because of the fact that network conditions changes over time and streams may interact with each other. This project describes a Stream-Based Overlay Network (SBON) with embed...
متن کاملNetwork Awareness in Internet-Scale Stream Processing
Efficient query processing across a wide-area network requires network awareness, i.e., tracking and leveraging knowledge of network characteristics when making optimization decisions. This paper summarizes our work on network-aware query processing techniques for widely-distributed, large-scale stream-processing applications. We first discuss the operator placement problem (i.e., deciding wher...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Telecommunication Systems
دوره 26 شماره
صفحات -
تاریخ انتشار 2003